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INTRODUCTION 


In  certain  Command,  Control,  and  Communication  (C^)  environments,  a 
number  of  human  operators  function  as  a  group  to  achieve  some  desired  objec¬ 
tive.  They  are  usually  aided  by  computers  and  other  automated  systems.  In 
such  supervisory  control  problems  proper  coordination  is  necessary  for  suc¬ 
cessful  operation.  It  is  not  always  clear  how  and  when  various  functions 
mu3t  be  allocated  to  different  operators. 

Certain  operations  require  some  specific  type  of  attention  (and  action 
by  the  human)  and  are  allocated  to  a  particular  individual.  But  there  are 
also  a  number  of  operations  that  do  not  fall  within  the  domain  of  a  particu¬ 
lar  operator.  Iwo  or  more  operators  may  be  jointly  responsible.  Depending 
upon  the  relative  workload  levels  at  any  particular  point  in  time,  one  of 
the  operators  jointly  responsible  will  perform  the  task.  The  objective  here 
is  to  understand  the  nature  of  attention  allocation  and  task  sharing  respon¬ 
sibilities  when  multiple  entities  are  responsible  for  system  operation. 

As  a  first  step,  this  requires  an  understanding  of  how  one  individual 
might  act  in  an  environment  where  his  attention  must  be  allocated  between  a 
number  of  competing  systems,  or  where  a  number  of  performance  criteria  are 
conflicting.  Due  to  the  cooperative  nature  of  the  problem  (since  the  opera¬ 
tor  wants  to  optimize  all  the  elements  of  the  vector  of  performance  indices) 
the  appropriate  solution  might  be  to  find  the  Pareto  optimal  set  of  solu¬ 
tions  . 
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The  Pareto  optimal  set  is  then  reduced  to  a  single  preferred  solution 
by  the  use  of  heuristics  or  other  relevant  information  employed  by  the  human 
operator.  Desirability  indices  for  various  alternative  actions  can  be  found 
using  fuzzy  set  theory.  The  particular  control  strategy  having  the  highest 
value  for  this  desirability  index  can  then  be  implemented.  A  model  for  the 
human  has  been  proposed  earlier  [1,2]  that  incorporates  the  above  features. 
Experiments  that  take  into  account  the  above  characteristics  are  needed  to 
validate  the  model  and/or  refine  it  if  necessary. 

OBJECTIVES 

An  experimental  paradigm  was  developed  for  a  threat  assessment 

scenario,  based  on  monitoring  the  spread  of  forest  fires.  Fires  originated 
from  five  sites  and  spread  outward.  Certain  areas  were  more  valuable  than 
others,  and  were  denoted  as  protected  zones  (PZ)  .  These  were  shown  as  cir¬ 
cular  arcs  [1,2].  The  envelope  within  which  the  path  of  the  fire  was  ex¬ 

pected  to  lie  was  indicated  by  fans  emanating  from  the  sites.  More  accurate 
information  aoout  the  path  of  the  fire  was  available  as  time  progressed. 

The  subjects  could  update  these  at  any  time.  Decisions  concerning  threat 
were  to  be  made  before  a  certain  time  limit.  Experiments  were  conducted 
where  a  number  of  human  operators  participated.  Complete  details  are  given 
in  [  1 ]. 

As  the  subjects  performed  the  experiments,  data  were  collected  about 
the  decisions  made  by  the  operators,  and  the  times  at  which  the  decisions 
were  made.  These  included  updates  as  well  as  threat  classification.  The 
primary  objective  of  the  mini-grant  has  been  to  analyse  the  experimental 
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results  for  modeling  purposes.  In  particular,  the  following  objectives  were 
desired . 

(1)  Identification  of  the  heuristics  and  strategies  used  by  the  hu¬ 
man  operator. 

(2)  Comparison  of  experimental  results  of  various  operators  for  the 
purpose  of  identifying  the  decision  making  strategies. 

(3)  Preliminary  verification  of  the  model  structure  with  regard  to 
the  appropriateness  of  the  use  of  various  heuristics. 

(J»)  Study  of  possible  alternatives  for  the  model  structure,  and 
modifications  of  the  experiment  for  further  research  in  modeling. 

STATUS  OF  THE  RESEARCH 

As  a  means  of  achieving  these  objectives,  computer  programs  were  writ¬ 
ten  to  analyze  the  experimental  data.  Using  the  data,  the  programs  "re¬ 
created"  the  experimental  conditions  when  the  subjects  made  decisions  con¬ 
cerning  threat.  This  enabled  us  to  determine  the  exact  configurations  at 
the  time  of  the  decision.  In  particular,  the  probability  of  damage  (pd)  and 
the  positions  of  the  fans  with  respect  to  the  protected  zones  were  evaluat¬ 
ed  .  The  programs  were  fairly  complex  since  the  exact  configurations  were 
required.  Modules  from  the  program  that  was  used  in  the  experiments  simpli¬ 
fied  the  programming  effort  somewhat. 

Analysis  of  the  data  was  carried  out  to  identify  the  operator’s  stra¬ 
tegies.  Since  a  large  amount  of  data  have  been  collected,  the  analysis  has 
not  been  completed .  Certain  major  trends  were  apparent  from  the  analysis 
thus  far  completed.  A  brief  summary  of  the  results  Is  given  here. 


The  subjects  cycled  through  the  sites  in  a  more  or  less  sequential 
order  when  there  was  a  lot  of  time  available.  After  about  two  or  three  cy¬ 
cles,  the  subjects  started  to  investigate  specific  sites.  Easy  identifica¬ 
tions  were  completed  before  going  on  to  more  difficult  (i.e.,  uncertain) 
sites.  More  updates  were  required  for  difficult  sites.  Sites  where  the 
probability  of  damage  was  near  0.5  proved  to  be  more  difficult  than  the  ex¬ 
treme  cases  (i.e.,  prf  close  to  0.0  or  1.0).  This  agrees  with  what  one  would 
expect  intuitively.  There  was  a  strong  tendency  to  identify  the  sites  with 

p.  near  0.5  as  threats.  Details  can  be  found  in  [2], 
d 

In  general,  most  of  the  heuristics  proposed  earlier  seem  reasonable. 
Formulation  of  appropriate  fuzzy  relationships  is  necessary  to  test  the  de¬ 
gree  of  applicability  of  the  rules.  A  major  observation  is  that  there  are 
two  distinct  phases  in  the  operation  of  threat  identification.  During  the 
first  phase,  uncertainties  of  all  the  sites  are  reduced  to  a  sufficiently 
low  level  by  cycling  through  all  the  sites.  This  phase  is  quite  straight¬ 
forward,  and  does  not  seem  to  impose  any  unusual  decision  making  loads. 
During  the  second  phase,  the  human  generates  a  set  of  alternatives  from 
which  a  single  site  is  chosen  for  update  and/or  threat  classification.  De¬ 
cision  concerning  threat  is  made  from  the  estimated  value  of  the  probability 
of  damage.  Errors  in  identification  were  higher  when  decisions  concerning 
threat  were  made  early.  There  was  perhaps  no  "Uncertainty  Reduction"  phase 
in  such  cases . 

A  crucial  point  in  the  development  of  the  model  is  the  determination 
of  when  the  subject  switches  from  the  initial  "Uncertainty  Reduction"  phase 
to  the  "Threat  Classification"  phase.  This  is  expected  to  be  a  function  of 
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the  time  remaining,  as  well  as  the  perceived  probabilities  of  damage.  De¬ 
tailed  analysis  is  needed  to  study  this  problem  further. 


During  trials,  certain  sites  were  more  error- prone  than  others.  These 
must  be  studied  separately.  Detailed  configurations  corresponding  to  these 
sites  might  reveal  some  features  not  anticipated  in  modeling.  Also,  the 
order  in  which  sites  were  classified  could  reveal  some  configurational  bias. 
Individual  variations  can  be  taken  into  account  in  the  model  by  appropriate¬ 
ly  varying  the  fuzzy  relationships.  All  these  features  will  be  studied  in 
detail  later . 


SUMMARY 

Experiments  involving  decision  making  in  a  time-constrained  environ¬ 
ment  were  completed.  Results  of  the  preliminary  data  analysis  indicate  that 
the  human  operator  might  be  using  subjective  criteria  after  the  initial  un¬ 
certainty  has  been  reduced  to  a  sufficiently  low  level. 

The  heuristics  proposed  appear  to  be  reasonable.  Testing  of  these  and 
identification  of  additional  heuristics  and  rules  can  only  be  performed 
after  additional  modeling  effort.  This  would  be  possible  after  the  ap¬ 
propriate  fuzzy  relationships  are  developed  based  on  various  heuristics. 

Alternate  modeling  techniques  are  also  being  explored.  In  particular, 
Semi-Markov  Decision  Processes  and  Artificial  Intelligence  techniques  appear 
to  be  attractive.  Another  possibility  is  to  study  this  as  a  Closed  Queueing 
Network  problem  with  time  varying  arrival  time  statistics.  A  formal 
research  proposal  is  being  prepared  based  on  the  results  of  the  research 
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conducted  during  the  duration  of  the  mini-grant.  The  proposal  will  be  sub¬ 
mitted  to  the  Air  Force  Office  of  Scientific  Research  in  the  near  future. 
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75.3  Appendix  1 

hUMAN  ATTENTION  ALLOCATION  STRATEGIES  IN  SITUATIONS  WITH  COMPETING  CRITERIA 
-  DEVELOPMENT  OF  AN  EXPERIMENTAL  PARADIGM  AND  OUTLINES  FOR  A  MODEL 


T.  GovindaraJ 

School  of  Induatrial  Engineering,  Purdue  University, 
Grissom  Hall,  West  Lafayette,  Indiana  V7907,  USA. 

R.  J.  Poturalski,  M.  M.  Vikmanis,  S.  L.  Ward 

Air  Force  Aerospace  Medical  Research  Laboratory, 
Wright-Patterson  Air  Force  Base,  Ohio  V5*t33,  USA. 


Abstract ■  In  supervisory  control  situations  involving  multiple  human  opera¬ 
tors,  proper  cooperation  and  coordination  among  the  operators  is  essential. 
In  addition  to  their  Individual  responsibilities,  the  operators  are  Jointly 
responsible  for  certain  aspects  of  the  system.  Time  available  for  decisions 
may  be  limited,  and  various  criteria  may  conflict  with  each  other.  Proper 
scheduling  of  tasks  is  necessary  for  optimal  performance.  In  such  situa¬ 
tions  it  is  usually  not  clear  when  and  who  should  take  responsibility  for 
the  Joint  tasks.  Understanding  how  multiple  operators  interact  requires  the 
understanding  of  single  operator  performance.  A  model  based  on  Pareto  op¬ 
timality  and  fuzzy  set  theory  has  been  proposed  for  the  human  operator.  An 
experimental  paradigm  has  been  developed  based  on  a  threat  assessment  situa¬ 
tion.  Features  of  the  paradigm  are  explained.  A  detailed  outline  for  the 
model  structure  is  given,  and  experimental  results  are  discussed. 


Kcraorfla.  Man-machine  systems;  Air  traffic  control;  Cognitive  systems;  De¬ 
cision  theory;  Game  theory;  Optimal  systems;  Applications  of  fuzzy  set 
theory. 


INTRODUCTION 

In  certain  Command,  Control,  and  Communica¬ 
tion  (CJ)  situations,  a  number  of  human 
operators  function  as  a  group  to  achieve 
some  desired  objective.  In  their  efforts  to 
perform  their  work  they  are  aided  by  comput¬ 
ers  and  other  automated  aystema.  In  such 
systems,  the  human  operator  Is  more  of  a  su¬ 
pervisor  than  a  almple  controller.  In  super¬ 
visory  control  where  more  than  a  single 
operator  is  Involved,  proper  coordination  is 
necessary  for  successful  operation.  Among 
other  things,  a  need  for  more  than  one  per¬ 
son  is  necessary  due  to  the  Increased  com¬ 
plexity  of  the  systems  that  dictate  various 
kinds  of  expertise,  as  well  as  the  mere 
r.umber  of  components  involved.  In  such  sys¬ 
tems,  more  often  than  not,  allocation  of 
various  functions  to  different  operators  is 
not  usually  clearly  defined. 

Of  course,  there  are  certain  operations  in 
each  of  the  various  subsystems  that  require 
some  specific  type  of  attention  (and  action 
by  the  human)  and  are  allocated  to  a  partic¬ 
ular  individual.  But  there  are  also  a  number 
of  operations  that  are  not  clearly  definable 
as  falling  within  the  domain  of  a  particular 
operator.  Two  or  more  operators  may  be 
Jointly  reaponaible  for  the  functions. 
Depending  upon  the  relative  workload  levels 
at  any  particular  point  io  time,  one  of  the 


operators  Jointly  responsible  will  take 
responsibility.  In  general,  computers  when 
working  with  the  human  can  be  used  to  per¬ 
form  soma  of  the  functions.  It  is  our  desire 
to  understand  the  nature  of  attention  allo¬ 
cation  and  task  sharing  responsibilities 
when  multiple  entities  are  responsible  for 
the  operation. 

We  need  to  understand  how  different  entitles 
work  together  in  s  cooperative  environment 
to  share  responsibilities.  As  s  first  step, 
this  requires  an  understanding  of  how  one 
individual  might  sot  in  an  environment  where 
his  attention  needs  to  be  allocated  between 
•  number  of  competing  systems  or  where  a 
number  of  performance  criteria  are  conflict¬ 
ing.  Though  a  nimber  of  mathematical  models 
have  been  proposed  for  multiple  task 
sequencing  by  a  single  operator,  (Rouse, 
1977;  Kriahna-Rao  and  othars,  I960),  they 
are  not  applicable  for  our  problem.  ftir 
problem  baa  tba  important  charaoteriatlo 
that  multiple  performance  criteria  are  in¬ 
volved.  The  criteria  are  distinctly  dif¬ 
ferent  from  each  other,  and  cannot  simply  be 
added  to  obtain  a  single  performance  index. 

Satisfaction  of  a  particular  criterion  night 
require  some  specific  action  that  night  con¬ 
flict  with  another  action  dictated  by  the 
need  or  desire  to  satisfy  another  criterion. 
In  an  actual  situation  there  may  be  more 
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than  two  criteria  that  must  be  satisfied 
siaultaneously.  By  satisfaction  of  a  cri¬ 
terion  is  aeant  talcing  an  action  that  would 
produce  optimum  results  if  that  criterion 
alone  were  to  be  considered .  In  practical 
situations,  coaproBises  are  often  made  so 
that  Instead  of  optimizing  a  single  perfor- 
aance  criterion,  a  number  of  criteria  are 
optialzed  siaultaneously.  Since  the  various 
criteria  are  in  general  not  additive,  they 
must  be  considered  as  elements  of  a  vector. 
Due  to  the  cooperative  nature  of  the  problem 
(since  the  operator  wants  to  optimize  all 
the  elements  of  the  vector)  the  appropriate 
solution  Bight  be  to  find  the  Pareto  optimal 
set  of  solutions.  These  are  the  non- 
dominating  set  of  actions,  no  single  action 
being  Bore  preferable  to  any  other  in  the 
absence  of  additional  information  or  con¬ 
straints. 

When  a  human  operator  is  Involved ,  he  uses 
his  experience  and  various  biases  to  reduce 
the  set  of  solutions  to  a  single  solution  to 
be  used  at  any  particular  choice  point. 
Hence  the  Pareto  optimal  set  is  reduced  to  a 
single  preferred  solution  by  the  use  of 
heuristics  or  other  relevant  information 
(see  GovlndaraJ,  1980).  In  aan-aachine  sys¬ 
tems,  the  human  operator's  heuristics  are 
better  expressed  in  terms  of  suitable 
linguistic  expressions.  Since  we  need  to 
quantify  the  variables  expressed  linguisti¬ 
cally  into  a  form  usable  when  the  Informa¬ 
tion  from  the  system  is  in  terms  of  numbers, 
the  most  appropriate  method  appears  to  be 
via  the  fuzzy  Set  theory.  Various  heuris¬ 
tics  and  rules  used  by  the  human  can  be  used 
to  define  the  appropriate  relationships 
between  the  different  entitles  that  make  up 
the  overall  system.  The  Pareto  optimal  solu¬ 
tion  set  can  be  generated  and  various  con¬ 
trol  strategies  can  be  assigned  appropriate 
"desirability  indices"  based  on  the  rules. 
The  particular  control  strategy  having  the 
highest  value  for  this  desirability  index 
(membership  function  in  fuzzy  sets)  can  then 
be  implemented .  Certain  features  in  the 
development  of  the  model  closely  follow  Za- 
deh  (1976). 


OBJECTIVES 


volved.  It  should  also  be  possible  to  vary 
different  parameters  so  that  the  effee.3  of 
different  paramters  can  be  studied .  The  ex¬ 
perimental  paradigm  is  set  up  with  the  aim 
of  modeling  the  human,  using  Pareto  optimal¬ 
ity  and  Fuzzy  Set  Theory.  Research  current¬ 
ly  in  progress  towards  realization  of  these 
objectives  is  described  in  the  following 
sections. 


AN  EXPERIMENTAL  PARADIGM 

A  typical  situation  that  has  the  charac¬ 
teristics  of  Interest  is  the  monitoring  of 
the  spread  of  forest  fires  that  occur  during 
summer.  This  threat  assessment  scenario  is 
simplified  somewhat  to  make  the  problem 
tractable.  The  essential  characteristics 
have  been  retained.  Since  the  primary  aim 
of  this  work  la  to  evaluate  the  possibility 
and  suitability  of  modeling  using  the  tech¬ 
niques  discussed  earlier,  the  details  of  the 
problem  are  not  crucial  as  long  as  the 
essential  factors  are  taken  into  account . 
Details  of  the  problem  can  be  better  under¬ 
stood  with  reference  to  Pig.  1.  The  main 
features  are  the  number  of  points  at  which 
fires  have  originated  ("sites"),  from  which 
fires  could  spread  to  other  areas  in  the 
Torest.  Certain  areas  in  the  forest  (or  on 
the  fringes)  are  more  valuable  than  others, 
for  example,  due  to  housing  and/or  other 
property.  These  are  called  Protected  Zones 
(PZ)  and  are  indicated  as  circular  arcs  in 
the  figure.  The  masber  of  locations  at 
which  fires  can  atart  has  been  fixed  at  5 
for  our  experiment.  The  operator  must 
determine  from  the  information  displayed  on 
the  screen  whether  the  sites  pose  a  threat 
to  the  protected  zones.  A  limited  amount  of 
time  is  available  to  make  this  decision. 
This  time  is  taken  to  be  between  two  and 
three  minutes.  (In  practice,  threats  must 
be  identified  In  a  few  hours,  and  the  avail¬ 
able  resources  must  be  allocated  optimally.) 
Mistakes  in  making  proper  decisions  are  ex¬ 
pensive.  There  are  two  types  of  mistakes: 
declaring  that  a  site  is  a  threat  when  it  la 
not  a  threat,  and  declaring  that  a  site  is 
not  a  threat  when  it  la  really  a  threat.  The 
operator  makes  this  decision  based  on  the 
information  available  on  the  screen. 


The  fundamental  problem  of  interest  concerns 
development  of  an  appropriate  paradigm  for 
studying  the  human  operator  characteristics 
discussed  above.  In  particular,  a  good 
understanding  of  the  features  of  the 
probiem/envlronment  that  are  useful  to  the 
human  In  arriving  at  decisions  to  be  imple¬ 
mented  is  desired.  Possible  heuristics  and 
strategies  that  the  human  uses  to  reduce  the 
size  of  the  feasible  set  of  solutions  must 
be  identified.  Hence,  the  experimental 
paradigm  must  incorporate  the  relevant 
features  of  the  environment,  without  making 
it  overly  complicated  that  it  becomes  impos¬ 
sible  to  Isolate  the  various  faotors  in- 


The  angular  envelope  within  which  the  tra¬ 
jectory  la  expected  to  lie  la  indicated  by  a 
fan.  The  fan  provides  the  95*  confidence 
interval  for  the  trajectory.  Within  this 
fan,  95*  confidence  interval  for  the  expect¬ 
ed  range  is  indicated  by  the  dotted  lines. 
The  envelopes  displayed  on  the  aereen  are 
based  on  the  estimate  of  the  information 
available  at  the  time  the  display  was  origi¬ 
nally  drawn.  As  time  progresses  more  accu¬ 
rate  information  becomes  available  for  each 
site,  but  it  is  not  displayed  automatically. 
At  any  time  the  operator  has  the  option  of 
.asking  for  more  information  concerning  any 
particular  site.  Since  it  takes  a  certain- 
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amount  of  time  to  obtain  the  required  infor¬ 
mation  from  a  site,  and  since  the  total  time 
available  within  which  the  decision  oust  be 
made  is  limited,  proper  scheduling  is  very 
important. 

A  line  perpendicular  to  the  center  line  of 
the  fan  gives  an  indication  of  the  estimated 
position  of  the  fire- front  with  reference  to 
the  starting  location.  This  line  is  con¬ 
tinuously  updated,  based  on  the  assumption 
that  the  velocity  of  the  front  is  known. 
Even  though  the  direction  of  the  center  line 
may  change  with  time,  the  front  position 
line  moves  along  the  center  line  correspond¬ 
ing  to  the  last  update.  This  line  is  the 
only  direct  indication  of  the  elapsed  time. 
The  operator  gets  an  estimate  of  tne  remain¬ 
ing  time  from  observing  the  position  of  this 
line  . 

At  any  point  in  time  the  operator  can  decide 
if  a  particular  site  is  a  threat  or  not  a 
threat,  or  can  continue  to  monitor  in  the 
hope  of  obtaining  more  reliable  information 
later,  better  quality  information  can  be  ob¬ 
tained  by  requesting  for  additional  informa¬ 
tion  at  any  time.  Since  the  initial  infor¬ 
mation  is  rather  crude,  the  rate  of  improve¬ 
ment  in  the  quality  of  the  information  is 
greater  in  the  beginning.  This,  along  with 
the  fact  that  more  time  is  available  to  make 
the  final  decision,  might  encourage  the 
operator  to  ask  for  more  information  in  the 
beginning.  however,  as  lime  goes  by.  the 
pressure  to  classify  a  3ite  increases  be¬ 
cause  appropriate  action  must  be  taken  if  it 
is  a  threat.  Hence,  the  Identification  of 
threat  is  made  taking  into  effect  all  thes» 
factors . 


EXPERIMENTAL  DETAILS 

In  our  experiment,  at  the  beginning  of  the 
trial  fires  start  from  all  five  sites.  X:;  j 
more  realistic  scenario,  fires  from  dif¬ 
ferent  sites  might  start  at  different  tints. 
In  fact,  we  do  not  know  how  many  distinct 
fires  start  in  a  forest.  Our  objective  is 
to  understand  how  decisions  are  made  when 
there  are  conflicting  criteria.  It  is  desir¬ 
able  to  avoid  factors  not  directly  related 
to  the  basic  problem.  Hence,  It  is  adequate 
to  start  all  the  fires  simultaneously.  The 
subject  can  update  any  site  merely  by  typing 
the  site  number.  In  a  real  life  8Atuat.cn, 
updating  information  takes  some  time  This 
reflecin  processes  such  as  calling  up  a 
source  of  information,  obtaining  relevant 
information,  processing  it,  and  updating  the 
display.  In  our  experiment  this  is  done  by 
freezing  the  display  for  5  seconds  Nh*-n 
the  subject  requests  an  update  for  a  partic¬ 
ular  site,  a  message  appears  indicating  that 
the  requested  site  is  being  update'1.  and 
after  5  seconds,  the  951  confidence  itter 
vals  are  updated.  When  the  nature  of  threat 
is  identified  for  a  site,  1  e.,  a  decision 
is  made,  that  site  is  removed  from,  the 
display.  The  experiment  proceeds  until  all 
the  sites  have  been  Identified  or  until  the 
pre-determined  time  ' imlt,  whichever  occurs 
first . 

The  experiment  has  been  run  in  real  time  or 
a  PDP  ’1/31*  computer  using  the  VT 1 1  Graphics 
system,  initial  training  runs  were  conducted 
for  a  week  to  familiarize  the  subjects  with 
the  experiment.  IXirlng  this  period  the  sub¬ 
jects  were  expected  to  develop  t  set  of  con¬ 
sistent  strategies  for  decisions.  The  sub¬ 
jects  were  encouraged  to  avoid  making  errors 
of  any  type.  A  score  based  on  the  correct¬ 
ness  of  the  decision  concerning  threat  and 
the  quickness  in  making  the  correct  decision 
was  calculated  for  each  site.  The  score  Tor 
a  site  is  the  time  remaining  at  the  time  the 
decision  was  made.  At  the  end,  the  display 
was  redrawn  to  Indicate  the  final  configura¬ 
tions  of  the  confidence  intervals,  and  the 
scores  were  displayed.  Incorrect  identifi¬ 
cations  were  shown  by  Hashing  the  confi¬ 
dence  Intervals  snd  giving  ssrc  scores. 
This  form  of  feedback  was  provided  during 
the  data  runs  ss  well . 

A  number  of  different  experimental  condi¬ 
tions  characterised  by  different  configura¬ 
tions  of  the  fane  were  used .  The  configura¬ 
tions  differed  in  terms  of  the  ares  of  over¬ 
lap  of  the  uncertainty  envelopes  with  the 
protected  tones.  This  represented  different 
levels  of  thrsat  probability.  Tsn  confi¬ 
gurations  for  aach  of  tbs  10  sessions  were 
used.  For  a  particular  session,  the  order 
of  presentation  was  randomised. 
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Fig.  1.  Threat  aaaeaament  scenario 
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PROPOSED  OUTLINE  FOR  THE  MOOED 


The  operator  functions  in  an  environment 
where  a  set  of  criteria,  not  necessarily 
commensurable ,  must  be  simultaneously  satis¬ 
fied  for  optimum  performance.  The  informa¬ 
tion  the  operator  has  about  the  system  can 
be  divided  into  two  main  categories.  One  is 
the  information  concerning  the  Predicted  End 
Point  (PEP)  at  which  the  fire  is  ex¬ 
tinguished.  The  PEP  is  shown  by  the  width 
of  the  fan  and  the  dotted  lines  Indicating 
the  range.  In  addition,  an  indication  of 
the  actual  range  of  the  fire  is  available 
from  the  front  position  line.  The  other  in¬ 
formation  is  the  perceived  probability  of 
damage  to  the  protected  zone,  pd,  given  by 
the  relative  size  of  the  area  of  overlap  of 
the  PZ  and  the  confidence  interval .  These 
are  related  to  each  other,  and  the  human  de¬ 
cides  on  a  particular  action  based  on  the 
above  and  the  time  available. 


The  threat  assessment  for  this  situation 
conslsta  of  assessing  the  potential  threat 
from  each  of  the  individual  sites.  If  it  is 
possible  to  eliminate  some  of  the  sites  from 
Turther  consideration,  i.e.,  by  deciding  if 
they  are  threats  or  no-chreats  early  in  the 
cycle,  more  time  is  available  to  decide  on 
the  remaining  sites.  To  set  up  the  cost 
functionals  for  the  problem  each  site  will 
be  assigned  a  set  of  costs.  For  any  site 
the  uncertainty/pressure  associated  with 
elapsed  time  (or  equivalently  time  remaining 

of 
other 

cost  is  the  amount  of  uncertainty  associated 
with  PEP.  This  latter  cost  could  be  directly 
related  tc  the  area  of  the  region  of  uncer¬ 
tainty  associated  with  PEP.  For  site  i,  the 
costs  are  J,  .,  the  cost  associ¬ 
ated  with  the  time  uncertainty  increases 
continuously  with  time.  In  addition,  a  cer¬ 
tain  amount  of  fixed  cost  should  perhaps  be 
added  whenever  new  information  is  requested, 
reflecting  the  fact  that  some  time  la  lost 
to  that  process. 


for  making  the  decision)  will  form  one 
the  costs  (Jn  for  the  itn  site).  The  ot 


values,  and  F  and  R  are  the  fan  width  and 
range  respectively.  At  any  point  in  time, 
the  human  might  possibly  be  ranking  the 
various  sites  in  order  of  importance  aa  po¬ 
tential  threats  and  decide  on  the  appropri¬ 
ate  action.  The  number  of  sites  (actively) 
competing  for  action  as  well  as  the  time 
remaining  will  influence  the  control. 


For  making  decisions  concerning  the  nature 
of  the  threat,  the  human  estimates  a  number 
of  quantities,  such  as  the  time  remaining, 
positions  of  the  fire-fronts,  and  the  re¬ 
gions  of  uncertainty.  The  estimation  prob¬ 
lem  is  a  difficult  one  because  the  operator 
has  no  control  over  the  fires'  propagation. 
The  parameters  influencing  their  propogation 
are  not  known.  Hence,  identification  of  the 
parameters  is  necessary  for  the  estimation 
problem.  When  the  uncertainty  envelopes  are 
updated ,  the  information  gained  could  be 
used  for  the  identification.  The  values  of 
the  parameters  thus  identified  could  be  used 
for  estimating  the  variables  between  up¬ 
dates  . 

From  the  estimates  of  various  quantities 
thus  obtained,  a  set  of  alternative  solu¬ 
tions  is  generated.  Methods  of  generating 
this  Pareto  optimal  set  are  being  explored. 
Heuristics  and  other  information  concerning 
the  threat  assessment  problem  are  formalized 
using  fuzzy  set  theory.  Fuzzy  relationships 
developed  from  these  are  used  to  reduce  thia 
Pareto  optimal  set  to  a  single  alternative. 
Figure  2  shows  a  schematic  block  diagram  for 
the  operator  model .  It  should  be  noted  that 
the  identification  block  gets  an  input  only 
when  there  is  an  information  update.  When  a 
decision  is  made  concerning  threat  or  when 
the  operator  is  uncertain,  and  after  infor¬ 
mation  updates  the  cycle  restarts  at  the  es¬ 
timation  block.  The  arrow  from  the  identif¬ 
ication  block  to  the  estimation  block 
represents  the  transfer  of  parameters.  De¬ 
tailed  structures  for  the  various  blocks  are 
being  worked  out . 


The  control  action  consists  of  the  determi¬ 
nation  of  which  site  to  investigate  at  any 
particular  time.  Thia  could  be  done  by 
sciiedullng  two  or  more  sites  to  be  investi¬ 
gated  consecutively.  Depending  upon  the  un¬ 
certainty,  in  general,  one  could  request  in¬ 
formation  concerning  the  range  (the  linear 
dimension)  and/or  the  fan  width  for  PEP. 
(In  our  experiment  both  of  these  are  updat¬ 
ed,  though  it  is  possible  to  update  only 
or.-.)  The  general  form  of  control  vector  is 
given  by 

u'*(tj,t^,..,)  (1) 

where  t  is  tne  time  at  which  site  i  Is  to 
he  updated.  The  perceived  probability  of 
damage,  p  la  given  by, 

Fd  =  Fd(t’VVra)  <2) 

where  the  subscript  p  denotes  the  perceived 
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Pig.  2.  Schematic  block  diagram  of  the  model 


11 

XV -92 


HUMAN  ATTENTION  ALLOCATION  STRATEGIES  IN  SITUATIONS  WITH  COMPETING  CRITERIA 


Appropriate  "desirability  indices"  oust  be 
associated  with  various  controls  that  fora 
the  Pareto  optiaal  set.  Rules  and  heuris¬ 
tics  that  might  be  used  by  the  human  need  to 
be  identified  for  this  purpose.  Examples  of 
some  possible  heuristics  are  given  below. 

1.  Do  not  ask  for  information  from  the  same 
site  consecutively,  unless  that  site 
could  be  eliminated  from  further  con¬ 
sideration. 

2.  After  each  enquiry  for  additional  infor¬ 
mation,  p.  is  updated  and  used  to  decide 
on  the  next  action.  If  p^  exceeds  an 
upper  limit  p  . ,  the  site  is  classified 
as  a  threat,  ana  if  p.  falls  telow  a 
lower  limit  p^o,  the  site  is  classified 
as  a  non-threat.  (Otherwise  a  decision 
is  postponed  due  to  uncertainty.) 

3.  If  the  time  available  is  decreasing,  and 
the  number  of  sites  is  large,  the  no¬ 
decision  range  (Pj.  -  p,  ) ,  is  reduced. 
This  reduction  could  i8ccur  after  each 
update  or  it  could  be  a  continuous  func¬ 
tion  of  time.  The  reduction  could  be 
achieved  by  lowering  phl ,  raising  p, 
or  by  changing  both. 

A.  If  damage  probabil ities  are  "about 
equal"  for  two  sites,  the  tendency  would 
be  to  update  the  site  having  the  higher 
uncertainty. 

•j.  'or  two  sites  having  "nearly  equal"  p 
'alues,  choose  the  site  having  the  value 
closer  to  the  decision  boundary  (i.e., 
near  p.  ,  or  p  )  . 

6.  If  p  for  aitei  is  closer  to  p.  . ,  and 

for  site  J  is  closer  to  p.  .choose 
site  i  (potential  threat  is  mori  impor¬ 
tant  than  a  non-threat). 

7.  In  trying  to  reduce  the  uncertainty  as¬ 
sociated  with  a  PEP,  if  the  reduction  in 
one  dimension  is  greater  than  in  the 
other  dimension,  choose  the  control  that 
would  result  in  maximum  expected  reduc¬ 
tion. 


‘'lo* 


8  The  uncertainty ,  and  hence  the  tendency 
*o  classify  a  site  as  a  threat,  in¬ 
creases  as  the  PEP  goes  closer  to  the 

PZ. 

9.  If  two  fire-fronts  propogate  with  dif¬ 
ferent  velocities,  the  front  with  the 
faster  velocity  is  more  of  a  threat, 
this  reflects  the  faster  rate  of  reduc¬ 
tion  of  the  available  time  for  the  fes¬ 
ter  front . 

’0.  After  the  "desirability  membership  func¬ 
tion"  values  are  calculated,  the  control 
is  not  implemented  if  the  value  of  this 
function  falls  below  a  certain  thres¬ 
hold  .  The  action  la  to  continue  monitor¬ 
ing. 


Tnis  list  is  by  no  mesna  complete.  Validity 
and/or  relevance  of  the  various  rules  can 
only  be  tested  by  matching  the  model  resulta 
with  the  experimental  results.  Unlike  the 
direct  problem  where  known  act  of  heuristics 
are  used  in  various  fuzzy  relationships,  we 
need  to  identify  proper  heuristics  end  stra¬ 


tegies  by  matching  results.  Hence,  this  la 
In  effect  an  inverse  problem,  an  important 
distinction  to  be  noted. 


EXPERIMENTAL  RESULTS 

Experiments  have  recently  been  completed. 
Detailed  analysis  of  the  results  are  being 
carried  out.  Only  a  few  of  the  important 
observations  will  be  given  here.  A  thorough 
analysis  must  wait  the  later  stages  of  the 
modeling  process.  The  subjects  cycled 
through  the  sites  in  a  more  or  leas  sequen¬ 
tial  order,  in  the  beginning,  when  a  lot  of 
time  was  available.  After  about  two  or 
three  cycles,  the  subjects  started  investi¬ 
gating  specific  sites.  Easy  identifications 
were  completed  before  going  on  to  more  dif¬ 
ficult  or  uncertain  sites.  Difficult  sites 
required  more  updates.  In  most  cases,  al¬ 
most  all  the  subjects  had  a  tendency  to 
identify  the  uncertain  aites  with  about  50% 
probability  of  damage  as  threats. 

Another  interesting  observation  was  that 
often  the  subjects  declared  a  site  a  threat 
If,  after  an  update,  the  "fan"  moved  towards 
the  Protected  Zone.  The  subjects  could  be 
using  some  form  of  a  predictor.  The  model 
could  include  this  as  a  dynamic  system 
driven  by  a  noiae.  The  driving  noise 
characteristics  must  be  determined  by  the 
model . 


POSSIBLE  APPLICATIONS 

In  addition  to  its  use  in  the  monitoring  si¬ 
tuation  considered  here,  the  model  could  be 
useful  in  a  number  of  other  situations.  The 
general  principles  apply  whenever  there  Is  a 
limited  time  Is  available  for  making  decl- 
aions,  and  different  criteria  conflict  with 
each  other.  Environments  where  such  condi¬ 
tions  could  exist  include:  air  traffic  con¬ 
trol,  air  defense  system,  monitoring  and 
control  of  the  apread  of  epidemics,  monitor¬ 
ing  the  propogation  of  oil  spllla,  chemical 
and  nuclear  wastes  etc.  The  time  scales 
could  be  different,  and  various  amounts  of 
time  may  be  available  for  different  con¬ 
texts.  Also,  priorities  could  be  different. 
When  these  factors  are  properly  taken  into 
account,  the  model  should  provide  a  means  of 
analyzing  the  situations. 


CONCLUSIONS 

One  of  the  most  important  aspects  of  under¬ 
standing  how  a  human  operator  makes  deci¬ 
sions  in  situations  involving  multiple,  pos¬ 
sibly  conflicting  criteria,  is  to  develop  a 
good  experimental  paradigm.  Such  a  paradigm 
has  been  developed.  The  model  structure  has 
been  formulated .  Possible  heuristics  that 
might  be  useful  for  the  t;odel  are  given. 
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These  fora  the  basic  steps  that  are  essen¬ 
tial  for  the  mathematical  modeling. 

Experiments  have  been  conducted.  The 
results  are  being  analyzed  to  determine  what 
strategies  and  heuristics  the  human  might 
have  used  for  the  decision  making  problem. 
A  detailed  model  structure  is  being  worked 
out.  The  mathematical  model  is  expected  to 
P'  « lde  results  that  match  what  is  observed 
in  the  experiments.  Modifications  and  re¬ 
finements  of  the  mathematical  model  may  be 
necessary  for  a  good  match  with  the  experi¬ 
mental  results. 

As  Indicated  earlier,  the  problem  considered 
here  is  part  of  a  much  bigger  problem,  viz. 
modeling  of  multi-operator  systems.  The 
current  modeling  effort  Is  expected  to  lead 
directly  and  naturally  into  the  bigger  and 
more  complex  problem  of  supervisory  control 
with  a  number  of  interacting  entitles. 
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ABSTRACT  OETAILS  OP  AN  EXPERIMENTAL  PARADIGM 


'In  the  operation  of  certain  supervisory  control 
systeas,  decisions  Must  be  aade  In  a  Halted 
'amount  of  tine,  and  various  perforaance  criteria 
'conflict  with  each  other.  Proper  scheduling  of 
tasks  and  appropriate  allocation  of  resources  are 
necessary  for  optiaal  perforaance,  and  in  soae  in¬ 
stances,  for  overall  safety.  Conditions  aay  pre¬ 
vail  where  it  is  usually  not  clear  when  different 
,  tasks  could  be  performed.  An  experimental  para¬ 
digm  has  been  developed  to  study  how  the  human 
monitor  operates  in  such  situations.  The  scenario 
used  is  similar  to  monitoring  the  spread  of  forest 
i  fires,  and  timely  identification  of  threatening 
] conditions.  Experiments  have  been  conducted  based 
on  the  above  mentioned  paradigm.  A  model  based  on 
Pareto  Optimality  and  Fuzzy  Set  theory  has  been 
developed  for  the  human  operator.  Results  of  the 
; experiments  are  described,  and  their  Implications 
j  for  the  model  are  discussed. 


|  ,  INTRODUCTION 

In  supervisory  control  where  more  than  a  single 
operator  Is  involved,  proper  coordination  is 
.necessary  for  successful  operation.  Allocation  of 
various  functions  to  different  operators  is  not 
[usually  clearly  defined.  At  any  time,  depending 
;  upon  the  relative  workload  levels,  one  of  the 
operators  jointly  responsible  will  perform  an 
operation.  Computers  when  working  with  the  hisaen 
| -an  also  be  used  to  perform  tome  of  the  functions. 

!  A  number  of  systems  aay  compete  for  attention, 
and/or  a  number  of  performance  criteria  may  con¬ 
flict  with  each  other.  The  criteria  could  differ 
from  each  other,  and  cannot  simply  be  added  to  ob¬ 
tain  a  single  performance  index.  Since  the  opera¬ 
tor  wants  to  optimize  all  the  elements  of  the  vec¬ 
tor,  the  appropriate  solution  would  be  to  find  the. 
Pareto  optimal  set  of  solutions.  From  this  a  sin-' 
gle  preferred  solution  Is  fowid  by  the  use  of 
heuristics  and/or  other  relevant  information.  An 
experimental  paradigm  has  been  developed  to  study 
this  situation.  Efforts  ere  being  made  to  model 
the  htaaan's  decision  making  behavior.  Details  of! 
the  experiment  and  the  model  are  given  In  the  fol-, 
)  lowing  sections.  j 


A  typical  situation  considered  here  is  the  moni¬ 
toring  of  the  propagation  of  forest  fires  (Figure 
1).  The  main  features  are  the  points  at  which 
fires  have  originated  (“sites"),  from  which  fires 
could  spread  to  other  areas  in  the  forest.  Cer¬ 
tain  areas  are  more  valuable  than  others,  for  ex¬ 
ample,  due  to  housing.  These  are  called  Protected 
Zones  (PZ)  and  are  Indicated  as  circular  arcs. 
The  operator  must  determine  from  the  information 
displayed  whether  the  sites  pose  a  threat  to  PZ. 
Time  available  to  make  this  decision  is  limited. 


The  angular  envelope  for  the  path  is  Indi¬ 
cated  by  a  fan.  It  provides  the  9SX  confidence 
Interval  for  the  path  .  The  confidence  In¬ 
terval  for  range  Is  Indicated  by  the  dotted  lines. 
The  envelopes  displayed  are  based  on  Information 
available  at  the  time  the  display  was  originally 
drawn.  As  time  progresses  more  accurate  informa¬ 
tion  becomes  available.  The  operator  can  ask  for 
.more  information  concerning  any  particular  site  at 
any  timo. 

A  lino  perpendicular  to  the  center  line  of  the  fan 
g*ves  an  indication  of  the  estimated  position  of 
the  fire-front.  This  line  Is  continuously  updat¬ 
ed,  based  on  the  asscmptlon  that  the  velocity  of 
'  the  front  Is  known.  The  front  position  line  moves 
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along  th a  cantar  11 ne  corre spending  to  the  List 
update.  This  line  Is  the  only  direct  Indication 
of  the  elapsed  tiae.  The  operator  gets  an  esti- 
aate  of  the  remaining  tiae  from  this  line. 

At  any  point  m  time  the  operator  can  decide  if  a 
particular  site  is  a  threat  or  not  a  threat,  or 
can  continue  to  monitor  in  the  hope  of  obtaining 
aore  reliable  information  later.  Since  the  ini¬ 
tial  Information  is  rather  crude,  the  rate  of  im¬ 
provement  in  the  quality  of  inforaation  is  greater 
<n  the  beginning. 

At  the  beginning  of  the  trial  fires  start  from  all 
five  sites.  The  subject  can  update  any  site  by 
typing  the  site  number.  (During  updates  the 
display  is  frozen  for  5  seconds.  In  a  real  life 
situation,  updating  inforaation  takes  some  time. 
This  reflects  processes  such  as  calling  up  a 
source  of  information,  obtaining  relevant  informa¬ 
tion,  processing  it,  and  updating  the  display.)  A 
aessage  appears  indicating  that  the  requested  site 
is  being  updated,  and  after  5  seconds,  the  confi¬ 
dence  intervals  are  updated.  When  the  nature  of 
threat  is  identified  for  a  site,  that  site  is  re¬ 
moved  from  the  display.  The  experiment  proceeds 
until  all  the  sites  have  been  identified  or  until 
the  pre-deteroined  time  limit,  whichever  occurs 
first . 

!lhe  experiment  has  been  run  in  real  time  on  a  POP 
|11/3c  compute "  using  the  VT11  Graphics  system.  In¬ 
itial  training  runs  were  conducted  for  a  week  to 
'familiarize  the  subjects  with  the  experiment.  Tne 
|subjects  were  encourageo  to  avoid  making  errors.  A 
!score  based  on  the  correctness  ot  the  decision 
concerning  threat  and  the  quickness  in  making  the 
jcorrect  decision  was  calculated  for  each  site. 
jThe  score  for  a  site  is  the  time  remaining  at  the 
: time  the  decision  was  made.  At  the  end,  the 
display  was  redrawn  to  indicate  the  final  confi¬ 
gurations  of  the  confidence  intervals,  and  the 
leores  were  displayed.  Incorrect  identifications 
•were  shown  by  fleshing  the  confidence  intervals 
and  giving  zt-ro  scores.  This  feedback  was  also 
‘provided  during  the  data  runs.  Details  can  be 
foLnd  *n  Hi. 


OUTLINE  f OP  THE  MODEL 

•The  information  the  operator  has  about  the  systea 
cen  he  div-ded  into  two  main  categoriea.  One  it 
the  information  concerning  the  Predicted  End  Point 
(PEP)  at  which  the  fire  is  extinguished.  The  PEP 
I  is  shown  b/  the  width  of  the  fan  and  the  dotted 
! liras  indicating  the  range.  In  addition,  an  indi- 
jeatien  of  the  actual  range  of  the  fire  1s  avail-, 
'able  from  the  front  position  line.  The  other  1n- 
t formation  is  th*  perceived  probability  of  damage 
to  the  protected  zone,  p.,  given  by  the  relative 
size  of  the  area  of  overlap  or  the  PZ  and  th*  con¬ 
fidence  Interval.  j 

| Control  action  consist*  of  determining  which  site 
‘to  investigate  at  any  particular  time.  This  could 
,  be  done  by  schedu' ing  two  or  more  sites  to  be  1n- 
vesti.aUd  consecutively.  At  any  time,  the  huaan 
i might  possibly  be  ranking  the  various  sites  in 


order  of  importance  as  pufential  threats  and  de¬ 
cide  on  the  appropriate  action.  The  number  of 
sites  competing  for  action  at  well  as  the  time 
remaining  will  Influence  the  control. 

To  decide  the  nature  of  the  threat,  the  huaan  es¬ 
timates  a  number  of  quantities,  such  as  the  time 
remaining,  positions  of  the  fire-fronts,  and  the 
regions  of  uncertainty.  The  estimation  problem  is 
rather  difficult  because  the  operator  has  no  con¬ 
trol  over  the  fires'  propagation.  When  the  uncer¬ 
tainty  envelopes  are  updated,  the  information 
gained  could  be  used  to  identify  parameters  of  the 
human's  model.  The  parameters  thus  identified 
coutd  be  used  to  estimate  the  variables  between 
updates. 

A  set  of  alternative  solutions  is  generated  based 
on  available  information.  Heuristics  and  other 
information  concerning  the  threat  assessment  prob¬ 
lem  are  formalized  using  fu2zy  set  theory.  Fuzzy 
relationships  developed  from  these  are  used  to 
choose  a  single  alternative  from  this  set.  When  a 
decision  is  made  concerning  threat  or  when  the 
operator  is  uncertain,  and  after  information  up¬ 
dates  the  cycle  restarts.  Detailed  structures  are 
being  pursued. 

Appropriate  "desirability  indices"  must  be  associ¬ 
ated  with  various  controLs  that  form  the  Pareto 
optimal  set.  Rules  and  heuristics  that  might  be 
used  by  the  human  need  to  be  identified  for  this 
purpose.  Examples  of  some  possible  heuristics  are 
given  below.  More  can  be  found  in  CD. 

1.  Oo  not  ask  for  information  from  the  same  site 
consecutively,  unless  that  site  could  be  elim¬ 
inated  from  further  consideration. 

2.  If  p  for  site  i  is  closer  to  p.  .,  and  p,  for 
site°j  is  closer  to  p.  ,  choose  iite  1  (poten¬ 
tial  threat  is  more  important  than  a  non¬ 
threat). 

These  rules  are  being  tested  by  matching  the  model 
results  with  the  experimental  results.  Urlike  the 
direct  problem  where  a  known  set  of  heuristics  ere 
used  in  fuzzy  relationships,  we  need  to  identify 
)proper  heuristics  and  strategics  by  matching 
result*. 

I 

EXPERIMENTAL  RESULTS  AND  IMPLICATIONS  FOR  MOOEUNG 

Experiments  have  recently  been  completed.  The 
remits  are  being  analyzed.  Only  the  preliminary 
results  are  given  here.  It  was  observed  that  the 
subject!  cycled  through  the  sites  in  a  more  or 
•less  sequential  order  when  a  lot  of  time  was 
available.  After  about  two  or  three  cycles,  tha 
'subjects  started  investigating  specific  sites. 
Easy  identifications  wara  completed  before  going 
on  to  mots  difficult  or  (ascertain  sites.  Diffi¬ 
cult  sites  required  more  ipdates.  In  moat  casta, 
I  tha  subjects  had  a  tendency  to  Identify  the  uncer¬ 
tain  sites  with  near  0.5  as  threats. 

Some  subjects  declared  a  site  a  threat  if,  after 
an  update,  the  fan  moved  towards  a  Protected  Zone, 
u  They  might  be  using  some  form  of  a  predictor  to 
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-■tr«poiatt>  the  PtP.  The  driving  noise  charac- 
•u  -.sties  for  the  predictor  could  be  dependent  on 
.he  motioi  of  the  tan  during  the  last  update. 

The  subjects  updated  a  site  prior  to  the  decision 
concerning  threat.  Sites  with  p  near  0.5  were 
more  difficult  to  classify  than  those  with  0.0  or 
After  cessions  with  relatively  large  number 
.it  errors  in  classification,  the  subjects  were 
ijund  to  take  more  time  and  make  smaller  number  of 
.-i-ti-s.  This  t.  old  perhaps  he  accounted  for  in 
•ne  model  by  changes  in  thresholds  and/or  the  ap- 
.rorriate  descriptive  parameters  of  the  membership 
f;  lions. 

lr  sfoea1 s  that  there  are  two  distinct  phases  in 
■»?  operation.  ihe  ‘irst  phase  consists  of  at- 
, smuts  to  irdu ce  tt-.  J'  'rtainties  associated  with 
..ii  the  sitt-i  t  ■  1  sufficiently  low  level.  In  the 
second  phase,  s  ces  are  chosen  tor  interrogation 
and  classification.  It  ’S  during  this  phase  that 
i.ie  human  ger..  ;es  a  set  of  alternatives  from 
ih-d  a  s'  j .  e  sil  -c  chosen  for  update.  The 
us.-ises  c  ;..id  -  labtl  .  0  at  11)  Uncertainty  Reduc- 

•  ion  (UR '  an  ,  Threat  Classi fication  (TC). 

'Hiring  i  >’>  pn  ,e,  .he  most  popular  scheme  ap- 

.yirs  be-  teoiP.  ti.il  upoates  of  sites.  A  crc- 

..  •i.i'  .  v:-t  ii  '."t*  re  e.upmei;i  o*  the  modei  is  the 

deter.?  inafic  of  .i.fi.  the  nor  an  switches  To  the  TC 
>ha;t  ’n  ,  ,s  obvious',  v  •>  function  ot  the  time 
'•miivij,  a«  w»ti  as  various  thresholds  and  rela¬ 
tive  va' uc"  f  uertP  'ver  nr „babi l  i t  ’ e s  o<  dumoge. 
n»tl  eg  ana.ysis  ;t  relucts  is  expected  to  pro- 
•ne  mure  in sigiit  mtu  this  phase. 

In  »he  ' p  ase,  rh<>  sues  could  be  grouped  into 
-hire  classes.  The  most  i;*ficult  are  the  ones 

•  i‘h  air. r.r  0.5.  with  decreasing  order  of  dif- 

■i.ultv,  the  other  two  classes  are:  0.25,0.75) 

nij  .0.0.  T.c)  .  Turn  set  memoership  functions 
"Jt  dep».  .  on  o'Ctabuity  should  thus  be  symmetr- 

<(  11  about  0.5.  This  c1  assi  fixation  along  with 
.rr;am  -er.holds  cou',.1  be  used  to  find  the  Pare- 
■o  optimal  set.  Heur' sties  characterized  by  ap- 
.  apriatf  fuzzy  rules  ins'  re . at ionsh i ps  could  then 
m»  ..eey  o  rhouse  one  particular  s’te  for  investi¬ 
gation. 

>  number  of  . ternat  ives  are  possible  to  accom¬ 
plish  the  selection  ot  a  site  for  update.  The 
rules  could  be  moiviOually  used  to  evaluate 
i  emb"  -  sh  •  p  f. net  ton  values,  hu  any  site,  the  ap~ 
p  of.-iste  val.."  ip-  trie  desirib’lity  index  could 
be  chose  ’  sir  if,  ii)  by  using  the  highest  member¬ 
ship  function  value,  or  (ii)  by  using  a  weighted 
funr  tior.  of  a  .tier  arc."  tear  ordering  between  rules. 
Another  alternative  is  vo  develop  and/or  identify 
various  fu zzy  relationships  that  would  provide  the 
f  drxirahii ity  function  value.  Reiativ*  importance 
of  vnrtous.  rules  could  form  the  basis  tor  these 
rei ationsnips.  The  site  having  the  highest  value 
,  could  then  be  interrogated.  Parameters  in  the 
-ii-'  could  be  changed  to  reflect  individual 
differences  between  operators,  and  trial-to-trial 
»-1at1on  among  operators. 


! 


ALTERNATE  MODELS 

An  attractive  alternative  for  modeling  appears  to 
be  the  use  of  Semi-Markov  Decision  Processes  [23. 
In  addition  to  the  number  of  sites,  a  state  for 
monitoring,  and  an  absorbing  state  corresponding 
to  site  identification  could  be  used.  The  main 
proDlem  here  is  the  determination  of  the  transi¬ 
tion  probabilities.  These  are  time  varying,  and 
there  appears  to  be  no  method  to  evaluate  these 
probabilities.  They  could  vary  depending  on  the 
number  of  sites  remaining,  and  after  each  update. 
Positions  of  fans  relative  to  the  protected  zones 
might  also  have  a  direct  influence  on  the  transi¬ 
tion  probabilities.  This  method  is  being  studied. 

Vet  another  method  is  the  develop  a  computer  model 
using  LISP  or  other  symbol  manipulation  languages. 
Programs  in  LISP  seem  to  be  particularly  attrac¬ 
tive  since  various  relations  and  hierarchical  ord¬ 
erings  between  rules  could  be  easily  programmed. 
This  and  other  artificial  intelligence  techniques 
such  as  Production  Systems  will  be  explored  in  de¬ 
tail.  Incorporating  the  history  (configuration 
changes  with  updates)  is  relatively  straightfor¬ 
ward  in  these  approaches. 


CONCLUSIONS 

An  important  aspect  of  understanding  how  a  human 
operator  makes  decisions  in  situations  involving 
multiple,  possibly  conflicting  criteria,  is  to 
develop  a  good  experimental  paradigm.  Such  a 
paradigm  has  been  developed.  The  model  structure 
has  been  formulated.  These  form  the  basic  steps 
That  are  essential  for  mathematical  modeling. 

Experiments  have  been  conducted.  The  results  are 
being  analyzed  to  determine  what  strategies  and 
heuristics  the  human  might  have  used  for  decision 
making.  This  should  help  identity  the  useful 
model  features.  A  detailed  model  structure  is  be¬ 
ing  worked  out. 

In  addition  to  its  use  in  the  monitoring  situation 
considered  here,  the  model  could  be  useful  in  e 
number  of  other  situations.  The  general  princi¬ 
ples  apply  whenever  there  is  a  Limited  time  avail¬ 
able  for  making  decisions,  different  criteria  con¬ 
flict  with  each  other,  and  priorities  are  dif¬ 
ferent  for  various  subsystems. 
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